The Item Response Warehouse (IRW) is a collection of open, harmonized item response datasets.
Open: The data are licensed for reformatting and public reuse. Their provenance is documented and code used to transform original data to meet the IRW data standard is available.
Harmonized: The data are formatted to a common standard. The goal of the IRW is to make large quantities of data available for standardized analysis given the common formatting.
Item Response: The IRW is comprised of cross-classified item responses. The key element required of data for inclusion in the IRW is that the data need to report individual responses that are cross-classified by the focus of measurement (typically a person) and the measurement tool (typically an item).
These datasets in IRW span a wide range of measures; examples include measures of ability in education settings, measures of partisanship based on voting records, and personality measures based on survey questions. Responses can be scored in a variety of ways (dichotomous, polytomous, continuous) and may contain additional data (e.g., response time).
Metadata
Examine sample sizes and other dataset summary statistics.
Code
vars =newMap([["Number responses","n_responses"], ["Number participants","n_participants"], ["Number items","n_items"], ["Responses per participant","responses_per_participant"], ["Responses per item","responses_per_item"], ["Sparsity (#responses/(#ids*#items))","sparsity"]])// vars = new Map(Object.entries(cont_vars))// console.log(Array.from(vars.values())[1])viewof x_var = Inputs.select(vars, {value:"n_items",label:"X axis"})viewof y_var = Inputs.select(vars, {value:"n_participants",label:"Y axis"})// selector for color variabledefault_color ="grey"color_opts =newMap([["None",null], ["Dichotomous vs. Polytomous","partition"]])viewof color_var = Inputs.select(color_opts, {label:"Color"})
Explore each dataset’s distribution of mean responses by item and subject.
Code
summaries_map =newMap(Object.entries(summaries))viewof dataset = Inputs.select(summaries_map, {label:'Dataset'})// transpose all data for plottingitems =transpose(dataset.items)subjects =transpose(dataset.subjects)metadata_trans =transpose(metadata)